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Abstract 

Standard game theory assumes that the structure of the game is common knowledge among 
players. We relax this assumption by considering extensive games where agents may be unaware of 
the complete structure of the game. In particular, they may not be aware of moves that they and other 
agents can make. We show how such games can be represented; the key idea is to describe the game 
from the point of view of every agent at every node of the game tree. We provide a generalization 
of Nash equilibrium and show that every game with awareness has a generalized Nash equilibrium. 
Finally, we extend these results to games with awareness of unawareness, where a player i may be 
aware that a player j can make moves that i is not aware of, and to subjective games, where payers 
may have no common knowledge regarding the actual game and their beliefs are incompatible with 
a common prior. 

keywords: Economic Theory, Foundations of Game Theory, Awareness, Solution Concepts. 
1 Introduction 

Standard game theory models implicitly assume that all significant aspects of the game (payoffs, moves 
available, etc.) are common knowledge among the players. While such common knowledge may seem 
unreasonable, there are well-known techniques going back to Harsanyi [12] for transforming a game 
where some aspects are not common knowledge to one where they are common knowledge. All these 
techniques assume that players are at least aware of all possible moves in the game. However, this is 
not always a reasonable assumption. For example, sleazy companies assume that consumers are not 
aware that they can lodge complaints if there are problems; in a war setting, having technology that an 
enemy is unaware of (and thus being able to make moves that the enemy is unaware of) can be critical; 
in financial markets, some investors may not be aware of certain investment strategies (complicated 
hedging strategies, for example, or tax-avoidance strategies). 
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In a standard game, a set of strategies is a Nash equilibrium if each agent's strategy is a best re- 
sponse to the other agents' strategies, so each agent i would continue playing its strategy even if i knew 
what strategies the other agents were using. To understand the relevance of adding the possibility of 
unawareness to the analysis of games, consider the game shown in Figure 1 . One Nash equilibrium of 
this game has A playing across^ and B playing downg. However, suppose that A is not aware that B 
can play downg. In that case, if A is rational, A will play down^. Therefore, Nash equilibrium does 
not seem to be the appropriate solution concept here. Although A would play across^ if A knew that B 
were going to play downg, A cannot even contemplate this possibility, let alone know it. 



across^ 



across 
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Figure 1 : A simple game. 



Our goal is to find appropriate solution concepts for extensive games with possibly unaware players, 
and more generally, to find ways of representing multiagent systems where some agents may not be 
aware of features of the system. To do this, we must first find an appropriate representation for such 
games. The first step in doing so is to explicitly represent what players are aware of at each node. We do 
this by using what we call an augmented game. An augmented game describes how awareness changes 
over time. For example, perhaps A playing across^ will result in B becoming aware of the possibility 
of playing downe. In financial settings, one effect of players using certain investment strategies is that 



other players become aware of the possibility of using that strategy Strategic thinking in such games 
must involve taking this possibility into account. 

We cannot in general represent what is going on using only one augmented game. The standard 
representation of a game implicitly assumes that (it is common knowledge that) the modeler and the 
players all understand the game the same way. This is no longer true once we allow for the possibility of 
unawareness, since a player's description of the game can now involve only those aspects of the game 
that he is aware of. Thus, the full description of the game with awareness is given by a set of augmented 
games, one for the modeler and one for each game that at least one of the agents thinks might be the 
true game in some situation. 

Continuing with the game in Figure 1 , the augmented game from the point of view of the type of B 
that is unaware of the possibility of playing down# would just include A's moves down^ and across a 
and the move across^. In that augmented game, player A is also unaware of the move downs- By way 
of contrast, the augmented game from the point of view of the type of B that is aware of down# would 
include the move downg, but may also allow for the possibility that A is not aware that B is aware of 
this move. 

The standard notion of Nash equilibrium consists of a collection of strategies, one for each player. 
Our generalization consists of a collection of strategies, one for each pair (i,V), where V is a game 
that agent i considers to be the true game in some situation. Intuitively, the strategy for a player i at V 
is the strategy i would play in situations where % believes that the true game is T'. To understand why 
we may need to consider different strategies consider, for example, the game of Figure 1. B would play 
differently depending on whether or not he was aware of downg. Roughly speaking, a set of strategies, 
one for each pair (i, V), is a generalized Nash equilibrium if the strategy for (i, V) is a best response 
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for player i if the true game is V, given the strategies being used by the other players in V. 

We argue that this notion of equilibrium correctly captures our intuitions. We then show that every 
game with awareness has a generalized Nash equilibrium by associating with a game with awareness 
a standard game (where agents are aware of all moves) such that there is a one-to-one correspondence 
between generalized Nash equilibria of the game with awareness and Nash equilibria of the standard 
game. 

For ease of exposition, for most of the paper we focus on games where agents are not aware of 
their lack of awareness. That is, we do not consider games where one player might be aware that there 
are moves that another player (or even she herself) might be able to make, although she is not aware 
of what they are. Such awareness of unawareness can be quite relevant in practice. For example, in 
the war setting described above, even if one side cannot conceive of a new technology available to the 
enemy, they might believe that there is some move available to the enemy without understanding what 
that particular move is. This, in turn, may encourage peace overtures. To take another example, an 
agent might delay making a decision because she considers it possible that she might learn about more 
possible moves, even if she is not aware of what these moves are. 

If we interpret "lack of awareness" as "unable to compute" (cf. [2]), then awareness of unawareness 
becomes even more significant. Consider a chess game. Although all players understand in principle 
all the moves that can be made, they are certainly not aware of all consequences of all moves. A more 
accurate representation of chess would model this computational unawareness explicitly. We provide 
such a representation. 

Roughly speaking, we capture the fact that player i is aware that, at a node h in the game tree, 
there is a move that j can make she (i) is not aware by having i's subjective representation of the game 
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include a "virtual" move for j at node h. Since i might have only an incomplete understanding of what 
can happen after this move, 

i simply describes what she believes will be the game after the virtual move, to the extent that she 
can. For example, if she has no idea what will happen after the virtual move, then she can describe her 
beliefs regarding the payoffs of the game. Thus, our representation can be viewed as a generalization 
of how chess programs analyze chess games. They explore the game tree up to a certain point, and then 
evaluate the board position at that point. We can think of the payoffs following a virtual move by j in 
z's subjective representation of a chess game as describing the evaluation of the board from z's point of 
view. This seems like a much more reasonable representation of the game than the standard complete 
game tree! 

Our framework is flexible enough to deal with games where there is lack of common knowledge 
about what is the game being played. In particular, we can deal with lack of common knowledge re- 
garding the utilities, who moves next, the structure of other players' information sets, and the probability 
of nature's moves (even in cases where there is no common prior compatible with the players' beliefs 
regarding nature). 

Recently, Feinberg [3, 4] also studied games with awareness. Feinberg [4] gives a definition of 
extended Nash equilibrium in normal-form games. Although his definition stems from much the same 
intuitions as ours (although some details are different — see Section 6), it is expressed syntactically. 
Each player is characterized by a complete description of what moves and players he is aware of, what 
moves and players he is aware that each other player is aware of, and so on through all levels of iterated 
awareness. Feinberg [3] deals with extensive-form games and defines solution concepts only indirectly, 
via a syntactic epistemic characterization. His approach lacks a more direct semantic framework, which 
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our model provides. He also does not deal with awareness of unawareness. 

The rest of this paper is organized as follows. In Section 2, we describe how we represent different 
awareness levels in a game. In Section 3, we use our representation to define a generalized notion of 
Nash equilibrium, and we prove its existence in games with awareness. In Section 4, we describe how 
we can extend our approach to deal with awareness of unawareness. In Section 5, we describe how to 
extend our framework to deal with games where there is lack of common knowledge, even if awareness 
is not an issue. We compare our work to others in the literature, particularly Feinberg's, in Section 6, 
and conclude in Section 7. 

2 Modeling awareness 

The first step in dealing with awareness is modeling it. To this end, we consider augmented games. We 
start with a standard game, described by a game tree T (as in Figure 1). An augmented game T + based 
on T essentially augments V by describing each agent's awareness level at each node, where player z's 
awareness level at a node h is essentially the set of runs (complete histories) in T that % is aware of at 
node h. A player's awareness level may change over time, as the player becomes aware of more moves. 

Our formal definition of augmented game is based on the definition of extensive game given by 
Osborne and Rubinstein [22]. We start by briefly reviewing Osborne and Rubinstein's definition. 

A (finite) extensive game is a tuple (N, M, H, P, f c , {2j : i € N}, {ui : i £ N}), where 

• N is a finite set consisting of the players of the game. 

• M is a finite set whose elements are the moves (or actions) available to players (and nature) during 
the game. 1 

1 Osborne and Rubinstein did not make M explicit in their definition of an extensive game; we find it convenient to make 
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• H is a finite set of finite sequences of moves (elements of M) that is closed under prefixes, so that 
if h € H and h! is a prefix of H, then h! € H. Intuitively, each member of H is a history. We 
can identify the nodes in a game tree with the histories in H. Each node n is characterized by the 
sequence of moves needed to reach n. A run in H is a terminal history, one that is not a strict prefix 
of any other history in H. Let Z denote the set of runs of H. Let Mh = {m G M : h- (m) 6 H} 
(where we use • to denote concatenation of sequences); Mh is the set of moves that can be made 
after history h. 

• P : (H — Z) — > N U {c} is a function that assigns to each nonterminal history h a member of 
N U {c}. (We can think of c as representing nature.) If P(h) = i, then player i moves after history 
h; if P(h) = c, then nature moves after h. Let Hi = {h : P(h) = i} be the set of all histories 
after which player % moves. 

• / c is a function that associates with every history for which P(h) = c a probability measure 
f c (- | h) on Mh- Intuitively, f c (- \ h) describes the probability of nature's moves once history h 
is reached. 

• 2j is a partition of Hi with the property that if h and h! are in the same cell of the partition then 
Mh = M^, i.e., the same set of moves is available at every history in a cell of the partition. 
Intuitively, if h and h' are in the same cell of 2j, then h and h' are indistinguishable from z's point 
of view; i considers history h' possible if the actual history is h, and vice versa. A cell / 6 2j is 
called an (i-)information set. 

• Ui : Z — > R is a payoff function for player i, assigning a real number (i's payoff) to each run of 
the game. 

it explicit here. 
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In the game of Figure 1 , 

• N = {A,B}, H = {(), (dowriyt), (across^, downg), (across^, across^)}, 

• P(()) = A, P((across A )) =B, 

• Ia = {(}}, Ib = {(acrossA)}, 

• UA((down A )) = u B ({down A )) = 1, 

• u A ((across a, across^}) = 0, and 

• ub ((across a, across^}) = 2. 

In this paper, as in most work in game theory, we further assume that players have perfect recall: 
they remember all the actions that they have performed and the information sets they passed through. 
Formally, we require that 

• if h and h! are in the same i-information set and h\ is a prefix of h such that P{h\) = i, then 
there is a prefix h[ of h! such that h\ and h[ are in the same information set; moreover, if hi ■ (m) 
is a prefix of h (so that m was the action performed when h\ was reached in h) then h[ ■ (m) is a 
prefix of h'. 

An augmented game is defined much like an extensive game; the only essential difference is that at 
each nonterminal history we not only determine the player moving but also her awareness level. Since 
the awareness level is a set of runs in a game T, we say that T + = (N + , M + , H + , P + , /+, {if : i <G 
iV + }, {uf : i G N + }, {Af : i G N + }) is an augmented game based on the (standard) extensive game 
T = (AT, M, H, P, f c ,{2i : i £ N},{iii : i £ N}) if the following conditions are satisfied: 
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Al. (N+, M+, H + ,P + , /+, {J+ : i G iV+}, {u+ : i G iV+}) is a (standard) finite extensive game 
where players have perfect recall. 

A2. ^+ : H+ -> 2 H describes i's awareness level at each nonterminal history after which player 
i moves. For each ft G ^~(ft) consists of a set of histories in i7 and all their prefixes. 
Intuitively, Af(h) describes the set of histories of T that i is aware of at history ft G (Hav- 
ing -A+(/i) consist of histories rather than just runs makes it easier to deal with awareness of 
unawareness.) 

A3. N + C N. 

A4. If P + {h) G iV + , then P + (h) = P(h), where ft is the subsequence of ft consisting of all the 
moves in ft that are also in M, and C M^. Intuitively, all the moves available to % at h must 
also be available to i in the underlying game T. 

A5. If P + {h) = c, then either P(h) = c and M+ C M^, or M+ n M = 0. The moves in M+ in the 
case where n M = intuitively capture uncertainty regarding a player's awareness level. 

A6. If h and ft/ are in the same information set inZ^ , then Af(h) = Af(h'). Intuitively, i's awareness 
level depends only on the information that i has. 

A7. If h is a prefix of ti and P + (h) = P + {ti), then Af(h) C This is a perfect recall 

requirement; players do not forget histories that they were aware of. 

A8. If h and h! are in the same information set in T + , then h and h! are in the same information set 
in r. 

A9. If h and h! are histories in both T + and T, and h and h! are in the same information set in T, then 
h and ft' are in the same information set in T + . 
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A10. For all i G N + and h G H+, if h', h" G ^(/i), h! and /i" are in the same information set in T, 
then h' ■ (m) G A^h) iff /i" • (m) G ^(/i). 

All. {z : 2 G Z'+j C Z\ moreover, for all i G N + , h G if z is a terminal history in Af(h) (i.e., if 
z G and z is not a strict prefix of another element of Af(h)), then z Q Z. Thus, the runs 

in Z + correspond to runs in Z, and players understand this fact. 

A12. For all % G and runs z in Z + , if ~z G Z, then it^~(z) = Ui(z). Thus, a player's utility just 
depends on the moves made in the underlying game. (By All, we have z G Z. We have included 
the clause "if z G Z" so that A12 is applicable when we consider awareness of unawareness, 
where we drop All.) 

Conditions A1-A12 are intended to capture our intuitions regarding information sets, awareness, 
and common knowledge. To allow us to focus on issues directly related to awareness, we have implicitly 
assumed that there is common knowledge of (1) who moves at histories in the underlying game (this 
is captured by the fact that P + (h) = P(h) unless P + (h) = c and n M = — either the same 
player or nature moves at both h and h unless nature makes an "awareness" move at h), (2) what the 
payoffs are in the underlying game (since u + (z) = u(z)), and (3) what the information sets are in the 
underlying game (see A8-A10). Our approach is flexible enough to allow us to drop these assumptions; 
see Section 5. 

To understand A8-A10, we must first discuss our view of information sets. As pointed out by 
Halpern [7], special attention must be given to the interpretation of information sets in game trees. This 
issue requires even more care in games with awareness. The standard intuition for information sets is 
that a player considers all the histories in his information set possible. But this intuition does not apply 
in augmented games. In an augmented game, there may be some histories in an i-information set that i 
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is not aware of; player i cannot consider these histories possible. For example, consider finitely repeated 
prisoners dilemma where Alice and Bob each move twice before their moves are revealed. Even if Bob 
is not aware of defection, his information set after Alice's first move in the modeler's game will still 
contain the history where Alice defects. 

We interpret an i-information set to be the set of all histories where player i has the same local state. 
Intuitively, this local states encodes all the information that i has about the moves he can make, what 
moves have been made, the other players in the game, his strategy, and so on. We assume that player z's 
local state is characterized by the sequence of signals that that i has received in the course of the game. 
Therefore, h and h' are in the same i-information set in T iff i received the same sequence of signals in 
both histories. 

In standard extensive games, the sequence of signals a player receives after every history h is as- 
sumed to be common knowledge. (This assumption is implicit in the assumption that the game, is 
common knowledge, and hence so are the information sets.) As we said, we continue to assume this 
in games with awareness (although we show how the assumption can be dropped in Section 5). That is 
why we require in A8 that if h and h! are in the same i-information in an augmented game, then h and 
h' must be in the same i-information set in the underlying game. The converse of A8 does not neces- 
sarily hold. It could well be the case that h and h' are in the same i-information set, but since i receives 
different signals from nature, h and h! are not in the same information set. On the other hand, if all the 
moves in h and h' are already in the underlying game, then if h and h! are in the same information set 
of T, they should be in the same information set of T + . This is the content of A9. Since, the signals 
received by a player determine the moves he has available, if player i is aware of two histories in the 
same information set in V, he must be aware of the same set of moves available at both of these histories. 
A 10 captures that intuition. 
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For the remainder of the paper, we use the following notation: for a (standard or augmented) game 
V s , we denote the components of T s with the same superscript s, so that we have M s , H s , and so on. 
Thus, from here on we do not explicitly describe the components of a game. 

An augmented game describes either the modeler's view of the game or the subjective view of the 
game of one of the players, and includes both moves of the underlying game and moves of nature that 
change awareness. For example, consider again the game shown in Figure 1 and suppose that 

• players A and B are aware of all histories of the game; 

• player A is uncertain as to whether player B is aware of run (across^, downs ) and believes that 
he is unaware of it with probability p; and 

• the type of player B that is aware of the run (across^, downs) is aware that player A is aware of 
all histories, and he knows A is uncertain about his awareness level and knows the probability p. 

Because A and B are actually aware of all histories of the underlying game, from the point of view of 
the modeler, the augmented game is essentially identical to the game described in Figure 1, with the 
awareness level of both players A and B consisting of all histories of the underlying game. However, 
when A moves at the node labeled A in the modeler's game, she believes that the actual augmented 
game is T A , as described in Figure 2. In T A , nature's initial move captures A\ uncertainty about B's 
awareness level. At the information set labeled AA, A is aware of all the runs of the underlying game. 
Moreover, at this information set, A believes that the true game is T A . 

At the node labeled BA, B is aware of all the runs of the underlying game and believes that the true 
game is the modeler's game; but at the node labeled B.2, B is not aware that he can play downg, and so 
believes that the true game is the augmented game T B described in Figure 3. At the nodes labeled A3 
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and B.3 in the game T B , neither A nor B is aware of the move downg. Moreover, both players think 
the true game is 




aware 

V-p) 



*m 



across^ across^ 
B.l 

T 



(U) 



* 



Figure 2: The augmented game T y 



acrossji 



across^ 



dowriji 



$4 

Figure 3: The augmented game T B . 

As this example should make clear, to model a game with possibly unaware players, we need to 
consider not just one augmented game, but a collection of them. Moreover, we need to describe, at each 
history in an augmented game, which augmented game the player playing at that history believes is the 
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actual augmented game being played. 

To capture these intuitions, we define a game with awareness based onT = (N, M, H, P, f c , {2j : 
i € N}, { Ui :ie N}) to be a tuple T* = (<?, T m , J 7 ), where 

• Q is a countable set of augmented games based on T, of which one is F m ; 

• T maps an augmented game T + G Q and a history h in T + such that P + (h) = i to a pair (r h , I), 
where r* 1 S 6 and / is an z-information set in game F h . 

Intuitively, T m is the game from the point of view of an omniscient modeler. If player i moves at h 
in game r + <G Q and ^"(r + , h) = (T h , I), then F h is the game that i believes to be the true game 
when the history is h, and / consists of the set of histories in T h he currently considers possible. For 
example, in the examples described in Figures 2 and 3, taking T m to be the augmented game in Fig- 
ure 1, we have F(T m , ()) = (T A ,I), where / is the information set labeled A.l in Figure 2, and 
F(T A , (unaware,across^)) = (T B , {(across^)}). 

It may seem that by making T a function we cannot capture a player's uncertainty about the game 
being played. However, we can capture such uncertainty by folding it into nature's move. For example, 
we capture ^4's uncertainty about whether B is aware of being able to move down^ in the augmented 
game T A illustrated in Figure 2 by having nature decide this at the first step. It should be clear that this 
gives a general approach to capturing such uncertainty. 

The augmented game T m and the mapping T must satisfy a number of consistency conditions. The 
first set of conditions applies to T m . Since the modeler is presumed to be omniscient, the conditions say 
that the modeler is aware of all the players and moves of the underlying game. 

Ml. N m = N. 
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M2. M C M m and {z : z € Z m } = Z. 

M3. If P m (/i) e AT, then M™ = A%. If P m (/i) = c, then either M™ n M = or M™ = and 
/ c m (- I M = /c(- I 

Ml, M2 and M3 enforce the intuition that the modeler understands the underlying game. He knows 
all the players and possible moves, and understands how nature's moves work in the underlying game V. 
It may seem somewhat surprising that there is no analogue of the second part of M3 (i.e., the constraint 
of f™) for all augmented games. While it makes sense to have such an analogue if nature's moves are 
in some sense objective, it seems like an unreasonable requirement that all player's should agree on 
these probabilities in general. This is especially so in the case that a player suddenly becomes aware of 
some moves of nature that he was not aware of before. It does not seem reasonable to assume that this 
awareness should come along with an understanding of the probabilities of these moves. Of course, we 
could require such an analogue of M3. Since the set of games that have such a requirement is a subset 
of the games we consider, all our results apply without change if such a requirement is imposed. 

Although the modeler understands the underlying game V, T m is not uniquely determined by T. 
There may be many modeler's games based on V, where the players have different awareness levels and 
the awareness changes in different ways. 

The game T m can be thought of as a description of "reality"; it describes the effect of moves in 
the underlying game and how players' awareness levels change. The other games in Q describe a 
player's subjective view of the situation. The constraints on the mapping T that we now describe 
capture desirable properties of awareness. 

Consider the following constraints, where T + G Q, h € H + , P + {h) = i, Af(h) = a, and 
F{T + ,h) = (T\l). 
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CI. {h:he H h } = a. 

C2. If ti G H h and P h (ti) = j, then A^(ti) C a and n {m : h' ■ (m) £a} = M y . 

C3. If h' and h are in the same information set in T+ and h' G a, then there exists h" G I such that 

r = tt. 

C4. If h' G /, then A^(h') = a and T{T h , ti) = (T h , I). 

C5. If h' G H + , P + (ti) = i, Af(h') = a, then if h and ti are in the same information set of T + , 
then JF(r+, h') = (r h , I), while if h is a prefix or a suffix of ti, then .F(r + , h') = (T h , I') for 
some i-information set I'. 

C6. If ti G I, then h and h' are in the same information set in T; 

C7. If T ft = T+, then ti & I iff h and h' are in the same i-information set in T + . 

C8. For all histories ti G I, there exists a prefix h[ of ti such that P h (ti 1 ) = i and JF^, h[) = 
(V, I') iff there exists aprefixhi of /i such that = iand^ r (r + , hi) = (r 7 , J'). Moreover, 

h'i • (m) is a prefix of h' iff hi • (m) is a prefix of h. 

C9. There exists a history ti £ I such that for every prefix h" ■ (m) of ti, if P h (h") = j G iV 7 * and 
^(r 71 , h") = (r', /'), then for all h x G /', hi • (m) G if'. 

CIO. If h' and h" are histories in both T + and r ft , then ti and h" are in the same z-information set in 
T + iff ti and h" are in the same i-information set in T h . 

Suppose that !F(T + , h) = (T h , I). Player i moving at history h in T + thinks the actual game is T h . 
Moreover, i thinks he is in the information set of I of F h . CI guarantees that the set of histories of the 
underlying game player i is aware of is exactly the set of histories of the underlying game that appear 
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in T h . C2 states that no player in F h can be aware of histories not in a. The second part of C2 implies 
that the set of moves available to player j at h! is just the set of moves that player % is aware of that are 
available to j at h' in the underlying game. C3 guarantees that for all histories h! indistinguishable from 
h that player % is aware of, there exists some history h" G I differing from h! at most in some moves of 
nature that change awareness levels. C4 says that at all histories in I player i indeed thinks the game is 
F h and that the information set is I. C5 says that player i's subjective view of the game changes only 
if % becomes aware of more moves and is the same at histories in H + that i cannot distinguish. C6 
captures the assumption that at all histories % considers possible, he must have gotten the same signals 
as he does in the actual history. 

C7 says that if while moving at history h player % thinks that F + is the actual game, then he considers 
possible all and only histories in the information set containing h. C8 is a consequence of the perfect 
recall assumption. C8 says that if, at history h, i considers h! possible, then for every prefix h[ of 
h! there is a corresponding prefix of h where i considers himself to be playing the same game, and 
similarly, for every prefix of h there is a prefix of h! where i considers himself to be playing the same 
game. Moreover, i makes the same move at these prefixes. 

The intuition behind condition C9 is that player % knows that player j only make moves that j is 
aware of. Therefore, player i must consider at least one history h! where he believes that every player j 
made a move that j was aware of. It follows from All, CI, C2, and C9 that there is a run going through 
I where every player j makes a move that player i believes that j is aware of. 

Since we assume that players have (modulo awareness) common knowledge about information sets, 
if T+ is the game from the point of view of player j (or the modeler) and there are histories h! and h" in 
both T + and T h , then player j (or the modeler) knows that player i gets the same signals in both h! and 
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h" iff he knows that player i knows that he gets the same signals in those histories. CIO captures that 
intuition. 

Just as F m is not uniquely determined by F, J^(r + , h) depends on more than just the awareness 
level of the player who moves at h. That is, even if Ai(h) = Ai(h'), we may have J r (F + , h) = (F h , I) 
and T(F + , ti) = (F h ',P) with F h + F h ' . We do not require that the awareness level determines 
the game a player considers possible. This extra flexibility allows us to model a situation where, for 
example, players 2 and 3, who have the same awareness level and agree on the awareness level of player 
1, have different beliefs about the game player 1 considers possible. 2 

A standard extensive game F can be identified with the game ({T m }, F m , J 7 ), where (abusing nota- 
tion slightly) F m = (T, {A{ : i € N}) and, for all histories h in an i-information set / in F, Ai(h) = H 
and JF(T m , h) = (T m , I). Thus, all players are aware of all the runs in F, and agree with each other and 
the modeler that the game is F. We call this the canonical representation ofF as a game with awareness. 

One technical issue: We have assumed that the set Q of games in a game F* with awareness is 

countable. For our purposes, this is without loss of generality. We are ultimately interested in what 

happens in the game F m , since this is the game actually being played. However, to analyze that, we 

need to consider what happens in other games in Q. For example, if h is a history in F m where i moves, 

we need to understand what happens in the game F h such that jF(r m , h) = (F h , •), since F h is the 

game that % thinks is being played at history h in F m . It is not hard to see that the set of games we need 
2 If the beliefs of players 2 and 3 regarding 1 are compatible with a common prior, then we can view players 2 and 3 as 
considering different information sets in the same game possible. However, if their beliefs are not compatible with a common 
prior, for example, if player 2 believes that player 1 believes that, in history h, Ti is the actual game with probability 1, and 
player 3 believes that, in history h, player 1 believes that T2 is the actual game with probability 1, where Ti ^ T2, then we 
cannot view players 2 and 3 as considering the same game possible. 
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to consider is the least set Q' such that T m G Q' and, for every T' €. Q and history h in T' such that 
JP"(r', /i) = (r", •), T" G Q'. Q' is guaranteed to be countable, even if Q is not. 

3 Local strategies and generalized Nash equilibrium 
3.1 Local Strategies 

In this section, we generalize the notion of Nash equilibrium to games with awareness. To do that, we 
must first define what a strategy is in a game with awareness. Recall that in a standard game, a strategy 
for player i is a function from i-information sets to a move or to a distribution over moves, depend- 
ing on whether we are considering pure (i.e., deterministic) strategies or behavioral (i.e., randomized) 
strategies. The intuition is that player i's actions depend on what i knows; the strategy can be viewed as 
a universal plan, describing what i will do in every possible situation that can arise. This makes sense 
only because i is presumed to know the game tree, and thus to know in advance all the situations that 
can arise. 

In games with awareness, this intuition no longer makes sense. For example, player i cannot plan 
in advance for what will happen if he becomes aware of something he is initially unaware of. We must 
allow i's strategy to change if he becomes aware of more moves. Let Qi = {T' G Q : for some T + G 
Q and h in T+, P + (h) = i and T(T + , h) = (V, ■)}. Intuitively, Q { consists of the games that i views as 
the real game in some history. Thus, rather than considering a single strategy in a game V* = (Q, T m , T) 
with awareness, we consider a collection {cr^ p : T' G Qi\ of what we call local strategies, one for each 
augmented game in Qi. Intuitively, a local strategy o-j p' for game V is the strategy that i would use if i 
were called upon to play and i thought that the true game was T'. Thus, the domain of cr^r' consists of 
pairs (T + ,h) such that T+ G Q, h is a history in T+, P + (h) = i, and T(T + ,h) = (T',I). 
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Define an equivalence relation ~j on pairs (V, h) such that V £ Q and h is a history in r' where 
i moves such that (Ti,h\) ~« (r2, h 2 ) if Ffii, ^1) = ^{^2, h 2 ). We can think of ~j as defining a 
generalized information partition in T* . It is easy to check that a ~j equivalence class consists of a union 
of i-information sets in individual games in Q. Moreover, if some element of a ~j equivalence class is 
in the domain of o-j p, then so is the whole equivalence class. At all pairs (F', h!) in a ~« equivalence 
class, if JF(r', h!) = (T h ' ,1), player i thinks he is actually playing in the information set / of T h ' . Thus, 
we require that o-j r/(ri, /ii) = cr^r'O^, h 2 ) if (Fi,hi) and (1^2,^2) are both in the domain of cr^r' and 

(ri, hi) ~j (r 2 , /i 2 ). 

The following definition summarizes this discussion. 

Definition 3.1 Given a game with awareness T* = (Q, T m , T), a local strategy aip for agent i is a 
function mapping pairs (T + , h) such that h is a history where i moves in T + and T(T + , h) = (V, I) to 
a probability distribution over M' h ,, the moves available at a history h' G /, such that cr^r'^i, hi) = 
o-i,r>(T 2 ,h 2 )if(ri,hi) ~i (T 2 ,h 2 ). 

Note that there may be no relationship between the strategies <7j ; r' for different games F'. Intuitively, 
this is because discovering about the possibility of a different move may cause agent % to totally alter his 
strategy. We could impose some consistency requirements, but we have not found any that we believe 
should hold in all games. We believe that all our results would continue to hold in the presence of 
reasonable additional requirements, although we have not explored the space of such requirements. 

3.2 Generalized Nash Equilibrium 

We want to define a notion of generalized Nash equilibrium so as to capture the intuition that for every 
player i, if i believes he is playing game V, then his local strategy a^r' is a best response to the local 
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strategies of other players in r'. 

Define a generalized strategy profile of F* = (Q, F m ,!F) to be a set of local strategies a = {cr^r' : 
i G N, V G Qi}. Let EUi^/{a) be the expected payoff for i in the game F' given that strategy profile 
a is used. Note that the only strategies in a that are needed to compute EXJi^' (<?) are the strategies 
actually used in F'\ indeed, all that is needed is the restriction of these strategies to information sets that 
arise in F' . 

A generalized Nash equilibrium of F* = (Q, F m , T) is a generalized strategy profile a such that for 
all F' € Qi, the local strategy c^r" is a best response to a_i yi >r /), where <?_(j,r') is the set of all local 
strategies in a except cr^r'. 

Definition 3.2 A generalized strategy profile a* is a generalized Nash equilibrium of a game F* = 
(Q, F m , J 7 ) with awareness if, for every player i, game F' £ Qi, and local strategy afar i in F', 

EUi, TI {d*)>EUi r {{d*_ {in ,a)). 

The standard definition of Nash equilibrium would say that a is a Nash equilibrium if a is a best 
response to <j_j. This definition implicitly assumes that player i can choose a whole strategy. This 
is inappropriate in our setting. An agent cannot anticipate that he will become aware of more moves. 
Essentially, if Ti / F2, we are treating player i who considers the true game to be Ti to be a different 
agent from the version of player i who considers F2 to be the true game. To understand why this is 
appropriate, suppose that player i considers Ti to be the true game, and then learns about more moves, 
and so considers F2 to be the true game. At that point, it is too late for player i to change the strategy 
he was playing when he thought the game was Fi. He should just try to play optimally for what he now 
considers the true game. Moreover, while player i thinks that the game Ti is the true game, he never 
considers it possible that he will ever be playing a different game, so that he cannot "prepare himself" 
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for a change in his subjective view of the game. 3 These considerations suggest that our notion of Nash 
equilibrium is appropriate. 

It is easy to see that <r is a Nash equilibrium of a standard game iff a is a (generalized) Nash 
equilibrium of the canonical representation of T as a game with awareness. Thus, our definition of 
generalized Nash equilibrium generalizes the standard definition. 

Consider the game with awareness shown in Figures 1 (taking this to be T m ), 2, and 3. We have 
Q A = {T A ,T B } and Q B = {T m ,T B }. Taking dom{a iyr <) to denote the domain of the strategy cr^rs 
we have 

dom(a Air A) = {{F m , ()), (r A , (unaware)), (r A , (aware))}, 
dom((JB,r m ) = {{r m , (across^)), (r A , (aware, across^))}, 
dom(a ArB ) = {(r B ,{))}, and 

dom(a B r B) = {(r A , (unaware.across^)), (r B , (across^))}. 
Each of these domains consists of a single generalized information set. If p < 1/2, then there exists a 

generalized Nash equilibrium where (J A ,v A = across^, &a,t b = down^, &B,r m = downe, &b,t b = 

across^. Thus, in the modeler's game, A plays across^, B plays downs, and the resulting payoff vector 

is (2, 3). On the other hand, if p > 1/2, then there exists a generalized Nash equilibrium where a A r A = 

down^, &a,t b = down^, (Tb,f™ = downe, a BT B = across^. Thus, in the modeler's game, A plays 

down^, and the payoff vector is (1, 1). Intuitively, even though both A and B are aware of all the moves 

in the modeler's game, A considers it sufficiently likely that B is not aware of downe, so A plays 

down^- There exists another generalized Nash equilibrium where a A r A = down^, a Ai r B = down^, 

cs,r m = across^, and (t b t b = across^ that holds for any value of p. Intuitively, A believes B will 
3 In games with awareness of unawareness, an agent may consider it possible that he will become aware of more informa- 
tion. But this too is incorporated in his view of the game, so he can still do no better than playing optimally in his current view 
of the game. 
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play across^ no matter what he (B) is aware of, and therefore plays down^; given that A plays down^, 
B cannot improve by playing down# even is he is aware of that move. 4 

We now show that every game with awareness has at least one generalized Nash equilibrium. We 
proceed as follows. Given a game T* = {Q,T m ,T) with awareness, let v be a probability on Q that 
assigns each game in Q positive probability. (Here is where we use the fact that Q is countable.) We 
construct a standard extensive game T u by essentially "gluing together" all the games T' G Q, except 
that we restrict to the histories in V that can actually be played according to the players' awareness 
level. Formally, for each T' G Q, we restrict to the histories [H'\ = {h G H' : for every prefix hi ■ (m) 
of h, if P'(fn) = i € N and jF(r', hi) = (T" , I), then for all h 2 € I, h 2 ■ (m) G H"}. As we shall 
see, all the components of T u are independent of v except for nature's initial move (as encoded by f% ). 
In T u , the set of players is {(i, V') : T' G Qi}. The game tree of T u can be viewed as the union of the 
pruned game trees of V G Q. The histories of T u have the form (V) ■ h, where V G Q and h G L-^^J • 
The move that a player or nature makes at a history (V) ■ h of T u is the same as the move made at h 
when viewed as a history of V . The only move in T u not determined by V* is nature's initial move (at 
the history ( )), where nature chooses the game V G Q with probability u(T'). 

Formally, let T u be a standard game such that 



{(i,V) -.T'eQi}; 



• M' 



G Ur'eg [M'\, where [M'\ is the set of moves that occur in [H'\ ; 



• H' 



()U{(T').h:r 



eg, he [H'\}; 



4 We did not discuss this latter equilibrium in the preliminary version of this paper. 
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• = c, and 



(i,r h ') if P h {h') = i e AT and 



p"((r h ) ■ /i') = < 



,/»') = (r h ',o 



c 



if P ft 



(ti) = c; 



v{T') and / C "(-Kr h ) • h') = f*(-\h') if P h {ti) 



= c; 



• X\ T , is just the ~j relation restricted to histories (r", h) G iT" where i moves and T(T" , h) has 
the form (r', •); 



Theorem 3.1 For all probability measures v onQ 

(a) T u is a standard extensive game with perfect recall; and 

(b) if v gives positive probability to all games in Q, then a is a Nash equilibrium ofT v iff a' is a 
generalized Nash equilibrium ofT*, where <7j i r'((r ft ') • h!) = a\ i»{T h , h'). 

Although a Nash equilibrium does not necessarily exist in games with infinitely many players, T u 
has three special properties: (a) each player has only finitely many information sets, and (b) for each 
player there exists a finite subset N(i,F') of N u such that (i,r)'s payoff in T u depends only 

on the strategies of the players in N(i, V), and (c) T v is a game with perfect recall. This turns out to 
be enough to show that T v has at least one Nash equilibrium. Thus, we get the following corollary to 
Theorem 3.1. 

Corollary 3.1 Every game with awareness has a generalized Nash equilibrium. 



• <,r'«r h >-*) 



v£(z) ifT h = T', 







if r h ^ r. 
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4 Modeling Awareness of Unawareness 

In this section, we describe how to extend our representation of games with awareness to deal with 
awareness of unawareness. In an augmented game that represents player z's subjective view of the 
game, we want to model the fact that % may be aware of the fact that j can make moves at a history h 
that i is not aware of. We do this by allowing j to make a "virtual move" at history h. Histories that 
contain virtual moves are called virtual histories. These virtual histories do not necessarily correspond 
to a history in the underlying game T (i.e., i may falsely believe that j can make a move at h that he is 
unaware of), and even if a virtual history does correspond to a history in V, the subgame that follows 
that virtual history may bear no relationship to the actual subgame that follows the corresponding history 
in the underlying game V. Intuitively, the virtual histories describe agent z's (possibly incomplete and 
possibly incorrect) view of what would happen in the game if some move she is unaware of is made by 
agent j. Player j may have several virtual moves available at history h, and may make virtual moves at 
a number of histories in the augmented game. 5 Note that agent i's subjective game may include virtual 
moves for i himself; i may believe that he will become aware of more moves (and may take active steps 
to try and learn about these moves). 

To handle awareness of unawareness, we consider a generalization of the notion of augmented game. 

We continue to refer to the generalized notion as an augmented game, using "augmented game without 

awareness of unawareness" to refer to the special case we have focused on up to now. Formally, T + = 

(N+,M+,H + ,P + J+,{1+ : i G N + },{uf : i G N + },{A+ : i G N+}) is an augmented game 
5 In the preliminary version of the paper, we assumed that all virtual moves were terminal moves. This is appropriate if i 
has no idea at all of what will happen in the game after a virtual move is made. The greater generality we allow here is useful 
to model situations where player i has some partial understanding of the game. For example, i may know that he can move 
left after j's virtual move, no matter what that virtual move is. 
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based on the (standard) finite extensive game T = (N, M, H, P, f c , {li : i G N}, {ui : i G iV}) if it 
satisfies conditions A1-A3, A6-A10 and A12 of augmented games, and variants of A4, A5, and A8. 6 
Before stating these variants we need to define formally the set of virtual histories of T + . The set of 
virtual histories V + ofT + is defined by induction on the length of histories as follows: 

1. if m G H+, m G M + - M, and either P+(0) G N+ or P+(0) = c = P(0), then m G V + ; 

2. ifh- (m) G H+ and h G V+, then h ■ (m) G V + \ 

3. if h ■ (m) e H+,me M + - M,h£ V + , and either P+(h) G N + or = c = P{h), then 
m G y + , where if h £ V + , then h is the subsequence of h consisting of all moves in h that are 
also in M, and if h G V + , then h = h. 

We can now state the variants of A4, A5, and A8. 

A4'. If P + (h) G N + and ft g V+, then P+(h) = P{h) and C U (M+ - M). 

A5'. If P + (ft) = c and ft ^ V+ then either P(ft) = c and M+ C U (M + - M), or P(ft) ^ c and 
M+ n M = 0. 

A8'. If ft and ft' are in the same information set in T + and ft, ft' ^ V + , then ft and ft' are in the same 
information set in V. 

A game with awareness of unawareness based on V is defined as a tuple T* = (^,r m ,^ r ) just 
as before. The modeler's extended game T m satisfies the same conditions M1-M3 as before, and the 
mapping T satisfies C3-C5 and C7-C10 and the following variants of CI, C2, and C6: 

CI'. {h:heH h ,h(£V h } = a. 

6 We could also relax A3 to allow some "virtual players". We do not do that here for ease of exposition. 
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C2'. If h! G and P h (ti) = j, then (a) A)(h') C a, (b) if /i' g then (1%/ n {m : /i' ■ (m) G 
a}) U (Af£ - M^) = M^„ and (c) if F(F h ,ti) = (F, J'), then for all ft" G /', we have 

C6'. If ft' e J and ft, ft' £ then ft and ft are in the same information set in T. 

CI' and C6' have been weakened so that these restrictions only apply to non- virtual histories of F h . Part 
(a) of C2' is the same as the first part of C2; part (b) implies that the set of moves available to player 
j at a non-virtual history h! is the set of moves that player i is aware of that are available to j at h' in 
the underlying game together with some virtual moves. It is not hard to check that in games without 
awareness of unawareness, part (c) follows from A4, CI, and C2, so it does not need to be explicitly 
stated in C2. However, now that A4 has been weakened to A4', we must mention it explicitly. 

Note that T m is an augmented game with no awareness of unawareness; there are no virtual moves, 
since the modeler is indeed aware of all possible moves (and knows it). We can now define local 
strategies, generalized strategy profiles, and generalized Nash equilibrium just as we did for games with 
awareness. The same technique as that used to show Corollary 3.1 can be used to prove the following. 

Theorem 4.1 Every game with awareness of unawareness has a generalized Nash equilibrium. 
5 Modeling Lack of Common Knowledge 

Game theorists have long searched for good approaches to modeling games where there is no common 
knowledge among players regarding the game being played. Our approach is flexible enough to handle 
such lack of common knowledge. In this section, we discuss the changes needed to handle lack of 
common knowledge. We remark that what we do here makes perfect sense even in games where there 
is full awareness. 
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We can modify our model to accommodate four different aspects of lack of common knowledge. 

• Lack of common knowledge regarding who moves. We assumed that every player understands 
who moves in each history he is aware of. Although we still need to require that every player 
knows when it is his turn to move, we can handle the case where a player has false beliefs about 
who moves after a history that is not in one of his information sets. For example, we are interested 
in modeling the case where player i may be confused after some history h as to whether player 
j or player k moves, but in both cases i still believes that the same moves are available. That is, 
player i knows what could happen next, but he does not know who is going to do it. (Later we 
model uncertainty not only regarding who moves but also regarding what the move is.) 

To explain the necessary modifications, we need one more definition. Let G m ,i be the smallest 
subset of Q such that if either T+ = T m or T+ € G m ,i, h G H+, P + (h) = i, and JF(r+ h) = 
(r', ■), then T' <G G m ,i- Intuitively, Qm,i consists of all games player i considers possible, or 
considers possible that he considers possible, and so on, at some history of the modeler's game. 

We can model lack of common knowledge about who moves by replacing A4 by 
A4". If P+(h) = i G N+, then M+ C Mj. 

Thus, we no longer require that the player who moves at history h is necessarily the one who 
moves at h. However, we do make this requirement for the modeler's game, since the modeler 
is assumed to understand the underlying game. Thus, we must add a requirement M4 for the 
modeler's game that is identical to A4 except that we replace T + by T m . 

Player i must also understand that he moves at a history h iff he moves at h for games in G m ,i- 
Cll. If T+ G G, h G H+, P+(h) = i, Af(h) = a, T(T + , h) = (T h , I), and b! G H h , then if 

29 



T h e Q rn ,i and P h (h') = i, then P(h') = i. Conversely, if P(h') = i, then there exists a 
prefix or suffix h" of h! such that h = h and P h (h") = i. 

We also need to make modifications to A5. Since we want to allow a player to have false beliefs 
about when nature moves, we replace A5 with 

A5". If P + {h) = c, then either C M^, or n M = 0. 

As before, the moves in in the case where n M = intuitively capture uncertainty 
regarding a player's awareness level. But now it may be the case that a player i falsely believes 
that nature moves after history h in the underlying game. Just as with A4, we must add a condition 
M5 to the modeler's game that is identical to A5, except that T + is replaced by T m . 

• Lack of common knowledge about the information sets. We assumed that every player understand 
the signals every other player receives in every history he is aware of. We can weaken this as- 
sumption by allowing a player to have false beliefs about the signals received by other players, or 
equivalently, by allowing a player to have false beliefs about the information sets of other players. 

We can model lack of common knowledge about the information sets by removing conditions 
A8-A10. Again, because we assume that the modeler understands the information sets, we would 
add analogues of A8-A10 to the conditions on the modeler's game (replacing T + by T m , of 
course). Similarly, we would require analogues of A8 and A9 to hold in the "C-list" of conditions 
for games T h G G m ,h an d we weaken C6 so that it also holds only for T h G G m ,i- We must 
also add an analogue of A10 to the "C-list" for games T h G Q m ^ for histories h! and h" in an 
i-information set. 

• Lack of common knowledge about payoffs. We assumed that payoffs depended only on moves 
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of the underlying game and that they were common knowledge among players. By dropping 
condition A12, we remove both of these assumptions. If we want to require that payoffs depend 
only on the underlying game, but still want to allow players to have false beliefs about the utilities, 
we would add an analogue of A12 in the modeler's game and use the following weakening of A12: 

AW. If T+ G g, z, z' G Z+, and z = z', then for all i G N+, uf{z) = uf(z'). 

Although the player j whose view of the game is F + may have false beliefs about the payoffs, 
player j knows that the payoffs depend only on the moves made in the underlying game. A12' 
captures that intuition. 

• Lack of common knowledge of the underlying game. We assumed players have common knowl- 
edge about the structure of the underlying game. Our framework can model a situation where 
each player has a completely different conception of what game is actually being played, which 
may have very little relationship to the actual underlying game (although we still assume that the 
modeler's game corresponds to the actual game). The key idea is to drop the assumption that all 
augmented games are based on the same game V. 

To formalize this intuition, we modify A2 so that the Af function does not necessarily map 
histories of an augmented game to histories of the same game V. Rather, A + (h) is the set of 
histories of some game T(h) that, intuitively, i considers to be the true underlying game. Thus, 
if h and h! are two histories in T + , then Af(h) and Af(h') may be histories in two completely 
different games. Since T(h) is viewed as z's subjective view of the true underlying game, 
we assume that he understands it perfectly. Thus, we retain Al, A6 and A8-A12 and replace 
conditions A3-A5 by M1-M3 (where the set of players is the set of players in T(h) and the 
projection function maps a history h to a history h in T(h)). With regard to A7, note that, even 

31 



if a player intuitively has perfect recall, he may realize in the future that he does not consider 
possible a history he considered possible in the past. 

In the definition of games with awareness, we allow Q to contain augmented games based on 
standard games different from the game on which T m , the modeler's game, is based. We continue 
to require conditions CI, C3-C5, C7-C9, and Cll, but we weaken C2. In C2 we required that 
a player i cannot consider possible a game T h where one of the players j moving in T h is aware 
of more runs than i is. In this setting, we allow i to consider possible a game T h where one of 
the players j moving in T h believes (falsely, from z's point of view) that some runs are possible 
that i does not consider possible. However, we require that the set of moves that i believes that j 
believes are available to him while moving at history h! in T h is a subset of the moves i believes 
are available to j while moving at ti. We thus replace C2 by the following condition C2", which 
is the analogue of parts (b) and (c) of C2'. 

C2". If ti e H h , P h {h') = j, and F(T h , ti) = (V, I'), then for all h" G /', M' h „ C M\[,, and 
M-g n{m:h'- (m) £a} = Mfy. 

Since we allow players to have false beliefs about information sets, we drop conditions C6 and 
CIO. However, since we have dropped A7 and weakened C2, we now need the following condi- 
tion, which requires that if a player considers possible a set of histories of the underlying game, 
then he cannot believe that in the future he will consider possible a different set of histories. 7 

C12. If h! € /, h" e H h , P h {h") = i, and h" is a suffix of ti, then A^ti) = A^{h"). 

7 Note that this does not rule out a situation where a player i realizes at history h! that his view of the game will change at 
a future history h" when he receives some additional information. If this is the case, then this should already be described in 
the set of histories that i considers possible at h! . 
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It is easy to see what C12 follows from A7, C2, and C4, which is why we did not list it explicitly 
earlier. 

This approach of allowing the augmented games in Q to be based on different underlying games 
actually subsumes our earlier approach and allows us to capture lack of common knowledge 
about who moves, what the information sets are, and what the payoffs are. For example, note that 
despite the fact that we have replaced A3-5 by Ml-3, we can also model games with awareness 
using this approach by taking the game T(h) to be the game consisting only of the runs of T 
that are in A + (h). (Of course, if we do that, we need to reinstate A7 and replace C2" with 
C2.) To capture lack of common knowledge about who moves, we take Y(h) to be identical to V 
except that different agents may move at a given information set. Similarly, we can model lack of 
common knowledge about what the information sets and what the payoffs are by restricting Y(h) 
appropriately. 

Despite all the changes to the conditions, the definitions of local strategies and generalized Nash 
equilibrium, and the theorems and their proofs remain unchanged. Thus, our techniques can deal with 
highly subjective games as well as awareness. 

6 Related Work 

There have been a number of models for unawareness in the literature (see, for example, [2; 14; 20; 21; 
1]). Halpern [8] and Halpern and Rego [10] showed that in a precise sense all those models are special 
cases of Fagin and Halpern's [2] approach where they modeled awareness syntactically by introducing 
a new modal operator for it. Halpern and Rego [11] extended Fagin and Halpern's logic of awareness 
to deal with knowledge of unawareness. All of these papers focused on logic, and did not analyze the 
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impact of unawareness in a strategic setting. 

Feinberg's [3, 4] work is most similar work to ours. We discussed the high-level difference be- 
tween our work and that of Feinberg in the introduction. Here we focus on some of the more detailed 
differences: 

• Feinberg does not model games semantically. He encodes all the information in the T function 
syntactically, by describing each player's awareness level and iterated nested awareness levels 
(e.g., what player 1 is aware that player 2 is aware that player 3 is aware of). 

• In dealing with extensive games, Feinberg [3] assumes that the runs that a player is aware of 
completely determine what game he believes he is playing. It cannot be the case that there are 
two distinct "identities" of a player that have the same awareness level. As we discussed in 
Section 2, this assumption limits the applicability of the model. 

• Feinberg assumes that if player i is aware of player j, then i must be aware of some move of player 
j. We do not require such a condition since the analogous condition is not typically assumed in 
standard extensive games. For example, in a standard extensive game, a player may get a payoff 
even though there is no node where he can move. But it is trivial to add this requirement (as it 
would be trivial to drop in Feinberg's framework), and making it has no impact on the results. 

• Feinberg [4] defines payoffs for player i by using what he calls "default actions" for players that 
i is unaware of. He says that this default action will be context dependent. We do not have such 
default actions in our setting; the payoff of a player in our framework is independent of the payoff 
of the players he is unaware of. The assumption of a default action seems somewhat problematic 
to us; it is not clear what the default move should be in general. Moreover, if two different players 
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are unaware of player j, it is not clear why (or whether) they should assume the same default 
action. 

• In dealing with extensive games, Feinberg [3] defines moves of nature by conditioning on the set 
of moves of nature the player is aware of. In our framework, this would amount to the following 
requirement: 

C13 If T+ e g, h G H+, P+(h) = i, A+(h) = a,J r (T+,h) = (T h ,I), h' G H h , P h {ti) = c, 
and Ml, n Mji ^ 0, then / c h (m | h') = jj^j^ for ever y m G M h> and fc( m I h ') = 
if m £ M^,. 

As Feinberg did, for that condition to be well defined we require that / c (m | /i) / for all 
m e M-^ and histories h. As we discussed in Section 2, while we believe such a requirement 
makes sense if nature's move is interpreted objectively, it does not make sense in general so we 
do not assume this in every augmented game. 

Sadzik [26] considers a logic of awareness, knowledge, and probability based on that of Heifetz, 
Meier, and S chipper [14], and uses it to give a definition of Bayesian equilibrium in normal-form 
games with awareness. Heifetz, Meier and Schipper [13] also consider a generalized state-space model 
with interactive unawareness and probabilistic beliefs and give a definition of Bayesian equilibrium in 
normal-form games, without assuming Feinberg's restriction. Li [17] has also provided a model of un- 
awareness in extensive games, based on her earlier work on modeling unawareness [18; 19]. Although 
her representation of a game with unawareness is quite similar to ours, her notion of generalized Nash 
equilibrium is different from ours. Just as we do, she requires that every player i make a best response 
with respect to his beliefs regarding other player's strategies in the game T % that i considers possible. 
However, unlike us, she requires that these beliefs satisfy a consistency requirement that implies, for 
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example, that if a player i is aware of the same set of moves for him at both information set I± in game 
T\ and information set I2 in T2, and these information sets correspond to the same information set in 
the underlying game T, then the local strategies cjj i r 1 and ai : r 2 must agree at these information sets; that 
is, <r ijri (Ji) = <Ti^ 2 {h)- 

Ozbay [23] proposes a model for games with uncertainty where players may have different aware- 
ness levels regarding a move of nature. He assumes that one of the players is fully aware, and can tell 
the other player about these moves before the second player moves. Although our model can easily 
capture this setting, what is interesting about Ozbay's approach is that the second player's beliefs about 
the probability of these revealed moves of are formed as part of the equilibrium definition. Filiz [5] uses 
Ozbay's model in the context of incomplete contracts in the presence of unforseen contingencies. In this 
setting, the insurer is assumed to be fully aware of the contingencies, and to decide strategically which 
contingencies to include in a contract, while the insuree may not be aware of all possible contingencies. 

Finally, we remark that our notion of a game with awareness as consisting of the modeler's game 
together with description of which game each agent thinks is the actual game at each history has much 
in common with the intuition behind Gal and Pfeffer's [6] notion of a Network of Influence Diagrams 
(NID). Formally, NIDs are a graphical language for representing uncertainty over decision-making mod- 
els. A node in a NID (called a block by Gal and Pfeffer) represents an agent's subjective belief about 
the underlying game and what the strategies used by agents depend on. Each node (game) in a NID is 
associated with a multiagent influence diagram [15] (MAID), which is a compact representation of a 
game. A NID has directed edges between nodes labeled by pairs of the form (i,H), where i is an agent 
and (in our language) H is a set of histories. Intuitively, if there an edges from a node (game) T to a 
node T' in a NID labeled by a pair (i, H), then H is a set a set of histories in T, there is an agent j that 
moves at all the histories in H, and in game T, i believes that j believes that V is the true game when 
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moving at a history h € H. 

Although Gal and Pfeffer do not try to handle notions of awareness with NIDs, it seems possible to 
extend them to handle awareness. To do this appropriately, consistency requirements similar to C1-C10 
will need to be imposed. 

7 Conclusion 

We have generalized the representation of games to take into account agents who may not be aware 
of all the moves or all the other agents, but may be aware of their lack of awareness. Moreover, 
our representation is also flexible enough to deal with subjective games when there is lack of common 
knowledge about the game, even if awareness is not an issue. We have also shown how to define 
strategies and Nash equilibrium in such settings. These generalizations greatly increase the applicability 
of game-theoretic notions in multiagent systems. In large games involving many agents, agents will 
almost certainly not be aware of all agents and may well not be aware of all the moves that agents can 
make. Moreover, as we suggested in the introduction, even in well-understood games like chess, by 
giving awareness a more computational interpretation, we can provide a more realistic model of the 
game from the agents' perspective. We remark that although we focus on generalizing extensive-form 
games, our framework is able to deal with normal-form games as well, since we can view normal-form 
games as a special case of extensive-form games. 

There is clearly much more to be done to understand the role of awareness (and lack of awareness) 
in multiagent systems. We list some of the many issues here: 

• We have assumed perfect recall here. But in long games, it seems more reasonable to assume that 
agents do not have perfect recall. In a long chess game, typical players certainly do not remember 
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all the moves that have been played and the order in which they were played. It is well known 
that even in single-agent games, considering agents with imperfect recall leads to a number of 
subtleties (c.f. [7; 24]). We suspect that yet more subtleties will arise when combining imperfect 
recall with lack of awareness. 

• In a Nash equilibrium of an extensive-form game, it may be the case that the move made at 
an information set is not necessarily a best response if that information set is not reached. For 
example, in the game described in Figure 1, even if both players have common knowledge of the 
game, the profile where A moves down and B moves across is a Nash equilibrium. Nevertheless 
moving down is not a best response for B if B is actually called upon to play. The only reason that 
this is a Nash equilibrium is that B does not in fact play. Sequential equilibrium [16] is a solution 
concept that is arguably more appropriate for an extensive-form game; it refines Nash equilibrium 
(in the sense that every sequential equilibrium is a Nash equilibrium) and does not allow solutions 
such as (down^, across^). Our representation of games with awareness (of unawareness) allows 
for relatively straightforward generalizations of such refinements of Nash equilibrium. However, 
there are subtleties involved in showing that generalized versions of these refinements always 
exist. For example, we no longer have a one-to-one correspondence between the generalized 
sequential equilibria of the game T* and the sequential equilibria of the corresponding standard 
game T v . Nevertheless, we believe that we should be able to use a more refined construction to 
show that a generalized sequential equilibrium exists in every game with awareness. 

• We have analyzed situations where agents may be unaware of some moves in the underlying game, 
may be aware of their unawareness, and may have completely false beliefs about the underlying 
game. Of course, there are other cases of interest where additional properties may hold. For 
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example, consider a large geographically-dispersed game where agents interact only with nearby 
neighbors. In such a game, an agent may be unaware of exactly who is playing the game (although 
she may realize that there are other agents besides her neighbors, and even realize that the moves 
made by distant agents may have an indirect effect on her). To model such a situation, we may 
want to have virtual moves after which the game does not end, and to allow agents to be aware of 
subsequences of histories in the underlying game. We suspect that a straightforward extension of 
the ideas in this paper can deal with such situations, but we have not worked out the details. 

• There has been a great deal of work on computing Nash equilibria. As we have shown, a gen- 
eralized Nash equilibrium of a game with awareness is a Nash equilibrium of a standard game. 
However, this standard game can be rather large. Are there efficient computational techniques for 
computing generalized Nash equilibrium in interesting special cases? 

• If there is little shared knowledge regarding the underlying game, the set Q of augmented games 
can be quite large, or even infinite. Is it important to consider all the iterated levels of unaware- 
ness encoded in Ql Halpern and Moses [9] showed that, in analyzing coordinated attack, no 
finite level of knowledge suffices; common knowledge is needed for coordination. Stopping at 
any finite level has major implications. Rubinstein [25] considered a variant of the coordinated 
attack problem with probabilities, and again showed that no finite level suffices (and significant 
qualitative differences arise if only a finite part of hierarchy of knowledge is considered). On the 
other hand, Weinstein and Yildiz [28] provide a condition under which the effect of players' fcth 
order beliefs is exponentially decreasing in k. While we strongly suspect that there are games 
in which higher-order unawareness will be quite relevant, just as with the Weinstein- Yildiz re- 
sult, there may be conditions under which higher-order awareness becomes less important, and 
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a simpler representation may suffice. Moreover, it may be possible to use NIDs to provide a 
more compact representation of games of awareness in many cases of interest (just as Bayesian 
networks provide a compact representation of probability distributions in many cases of interest), 
leading to more efficient techniques for computing generalized Nash equilibrium. 

We hope to explore some of these issues in forthcoming work. 
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A Proofs 

Theorem 3.1: For all probability measures v onQ 

(a) T v is a standard extensive game with perfect recall; 

(b) if v gives positive probability to all games in Q, then a is a Nash equilibrium ofT v iff a' is a 
generalized Nash equilibrium ofT*, where ai^'{(p h ) • h!) = a\ r i{T h , h'). 
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Proof: For part (a), suppose that (T') ■ h[) and (r") • h'{) are in the same (i, T + ) -information set of 
T" and that h' 2 is a prefix of h[ such that P v ({Y')h' 2 )) = (i, By definition of r", it must be the 
case that there exist i-information sets I\ and I2 in T + such that !F(T', h[) = !F(T", h'[) = (T + , I\) 
and T(X' , h! 2 ) = (r + , I 2 ). If h\ is a history in l\, C8 implies that there exists a prefix hi of h\ such 
that P + {hi) = i, T(T + , h 2 ) = (T + , I 2 ) and if h 2 ■ (m) is a prefix of h[, then hi ■ (m) is a prefix 
of hi. Applying C8 again, it follows that there exists a prefix h 2 of h'{ such that P T " \h 2 ) = i and 
TlX" 1 h'2) = h) and if h 2 ■ (m) is a prefix of hi, then h 2 ■ (m) is a prefix of h'[. Therefore, by 
definition of r", (r", h 2 ) and (r', h! 2 ) are in the same information set. 

Suppose further that h 2 ■ (m) is a prefix of h[. Thus, h 2 ■ (m) is a prefix of hi, which implies that 
h 2 ■ (m) is a prefix of h". This proves part (a). 

For part (b), let Pr v s be the probability distribution over the runs in T v induced by the strategy profile 
a and f". Pr v 3 [z) is the product of the probability of each of the moves in z. (It is easy to define this 
formally by induction on the length of z; we omit details here.) Similarly, let Pr^, be the probability 
distribution over the runs in F h € Q induced by the generalized strategy profile a' and fj}. Note that if 
Pr%{z) > 0, then z G L-^^J- Thus » ( rh ) • z G H " '■ 

For all strategy profiles a and generalized strategy profiles a', if a[ r /(T ft , h!) = Oi£'{X h ) 'h'), then 
it is easy to see that for all z E Z h such that Pr'i, (z) > 0, we have that Pr%((r h ) ■ z) = v{T h )Pr^, (z). 
And since v is a probability measure such that v(T h ) > for all T h € Q, we have that Pr^({T h ) ■ z) > 
iff Pr^,{z) > 0. Suppose that a is a Nash equilibrium of T v '. Suppose, by way of contradiction, that a' 
such that a[ r /(T /l , h') = <Ji^>{X h ) ■ h!) is not a generalized Nash equilibrium of V*. Thus, there exists 
a player i, a game T + € Qi, and a local strategy s' for player i in T+ such that 



43 



£ Pr+(z)u+(z) < ]T p rp + taf) (z)uf(z). (1) 

Define s to be a strategy for player (i, T + ) in T u such that s((T h ) ■ h!) = s'(T h , h'). Multiplying (1) 
by v(T + ) and using the observation in the previous paragraph, it follows that 

J2 P^((r + )-z)ui(z)< J2 Pr\ 3 .)(<r + ) ■*)«+(*). (2) 
ze[_z+\ ze[z+\ 

By definition of u v iV ,, (2) holds iff 

£ Prg^KVCz") < E Prf- )(z"KV(0- (3) 

Therefore, <? is not a Nash equilibrium of T u , a contradiction. The proof of the converse is similar; 
we leave details to the reader. | 

Corollary 3.1: Every game with awareness has a generalized Nash equilibrium. 

Proof: For games with perfect recall, there is a natural isomorphism between mixed strategies and 
behavioral strategies, so a Nash equilibrium in behavior strategies can be viewed as a Nash equilibrium 
in mixed strategies [22]. Moreover, mixed-strategy Nash equilibria of an extensive-form game are the 
same as the mixed-strategy Nash equilibria of its normal-form representation. Salonen [27] showed that 
there exists a Nash equilibrium in mixed strategies in a normal form games with an arbitrary set N of 
players if, for each player i, the set Si of pure strategies of player i is a compact metric space, and 
the utility functions U{ : S — > M wee continuous for all i € N, where M is the set of real numbers 
and S = Hi^Si, the set of pure strategies, is endowed with the product topology. Since in r", every 
player has a finite number of pure strategies, Si is clearly a compact metric space. Moreover, since each 
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player's utility depends only on the strategies of a finite number of other players, it is easy to see that 
Ui : S — ► -ZR is continuous for each player i G N. It follows that there exists a Nash equilibrium of T u . 
Thus, the corollary is immediate from Theorem 3.1. I 
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